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[57] ABSTRACT 

A method and apparatus for supplying new requests to a 
scheduler in an input-buffered multiport switch involve 
selecting a request that does not target output channels that 
conflict with output channels targeted by requests that are 
already accessible to the scheduler. Specifically, target out- 
put channels of requests that are presently accessible to the 
scheduler are identified and compared to target output chan- 
nels of requests that are included in a queue of next-in-line 
requests. The queue of next-in-line requests is reviewed and 
the highest priority request having no conflicting output 
channels is supplied to the scheduler. By supplying the 
scheduler with a new request that targets non-conflicting 
output channels, the scheduler is presented with a wider 
range of requested output channels from which to choose in 
each arbitration cycle. In a first embodiment, one, two, or 
eight ports are connected to each one of four input/output 
controllers in a switch having a four-channel switch fabric. 
To supply the scheduler with new requests, secondary arbi- 
tration is performed on a channel-specific basis in order to 
supply channel-specific requests to the scheduler. The 
method of supplying requests to the scheduler can be scaled 
to include multiple channels and multiple packet priority 
designations. 
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METHOD AND APPARATUS FOR Parallel input queues provide a separate FIFO queue for 

SUPPLYING REQUESTS TO A SCHEDULER each output channel of the switch, with each queue provid- 

IN AN INPUT BUFFERED MULTIPORT ing a corresponding request to the scheduler. Referring to 

SWITCH FIG. 2, an N input channel by N output channel switch 

s requires N input queues 46 for each input channel for a total 

TECHNICAL FIELD 0 f N 2 input queues. With an N 2 scaling factor, the number of 

The invention relates generally to the scheduling of input queues connected to the crossbar scheduler 50 may be 

packets in a high-bandwidth input-buffered multiport vei 7 high- For example, in a 16X16 switch, 256 separate 

switch, for instance as used in gigabit ethernet networks. <l ueues are required. In spite of the added complexity, the 

More particularly, the invention describes a process for 10 ^vantage that the parallel design provides is that, with 

supplying requests to a scheduler. ' es P ect '° ^ one of th u e m Vf channels a series of requests 

for available output channels is not held up by a single 

BACKGROUND OF THE INVENTION request for in-use output channels. 

Networks are widely used to transfer voice, video, and A variety of arbitration techniques can be used with 

data between various network devices such as telephones, parallel input channels to provide an efficient throughput 

televisions, and computers. Data transmitted through a net- thrcm S h a switch - For example, maximum matching algo- 

work'is typically segmented into packets and under some ntl ? ms are designed in an attempt to assign output channels 

network protocols data is segmented into fixedlength cells. t0 m P ut channels m * uch a ^ ' hat a maximum number of 

For example, Asynchronous Transfer Mode (ATM) protocol ivaD * f ™ occur simultaneously. However under heavy load 

« il . ii ',l c u * c u it J • j conditions, maximum matching algorithms can prevent 

requires 53-byte cells, with 5 bytes of each cell designated 2Q ^ ^ from * J & Qew ^ 

for a header and 48 bytes of each cell designated for payload. Mem For e ^ referrin tQ nG ^ . channel j 
Other network protocols, such as ethernet or Internet ^ represented as requesting to transfer cells from its output- 
protocol, carry data in variable-size packets. distributed queue 54 to output channel 1 only, while input 
Switches are integral parts of most networks. Switches channel 2 is requesting to transfer cells from its output- 
receive packets from input channels and direct packets to the 25 distributed queue 56 to output channels 1 and 2. Under a 
appropriate output channels of the switch. Typical switches maximum matching approach, input channel 1 transmits 
have three components: a physical switch fabric to provide cells to output channel 1 and input channel 2 transmits cells 
the connections from input channels to output channels, a to output channel 2. However, input channel 2 will be 
scheduling mechanism to direct traffic when multiple pack- blocked from transferring cells destined for output channel 
ets arrive on different input channels destined for the same 30 1, since this would require the cell transfer from input 
output channel, and a buffering or queuing mechanism at the channel 1 to output channel 1 to stop, and as a result, only 
switch input or output to accommodate traffic fluctuations output channel 1 would be utilized. As shown in FIG. 4, 
without undue packet loss. FIG. 1 is a diagram of a prior art sending cells from input channel 2 to output channel 1 
switch 10 that has four input channels 12, 14, 16 and 18 and c ™ se / mput channel 1 and output channel 2 to remain idle 
four output channels 20, 22, 24 and 26. The switch has serial 3S and does not achieve maximum matching, 
input queues 28, 30, 32 and 36 for each input channel, a Arbitration methods developed to optimize performance 
crossbar physical switch 38, and a crossbar scheduler 40. °J ^ ^P ced f f he * utl ^ / ara Ue * .^f^!? ™ 
The crossbar scheduler receives a signal, referred to as a f cIos ^ m U f No. 5,500^58 entitled "Metood and 
4 c . <, \ - . , a. * * Apparatus for Switching Cells in an Input- Queued Switch, 
request from an input queue The request dictates the output ^ tQ McKeown afl | in v s p at N £ 5^7,495, entitled 

channe or channels that will receive the queued packet. The 40 u ^ Priodtized scheduling in an Input-Buffered Switch," 

scheduler arbitrates between competing requests and sends tQ Lund et al Mihough th ese arbitration approaches 

a signal, referred to as a grant, back to the input buffers that are effective for me ir intended purpose, they both require 

have been selected to deliver a packet. that an switch have N 2 distinct FWQ input queues 

In switches such as the switch 10 described in reference S i nce tnere are ^distinct FIFO input queues, there will also 

to FIG. 1, each input queue 28-36 provides requests to the 45 be N 2 requests delivered to the scheduler. As the number of 

scheduler 40 one at a time on a first- in-first-out (FIFO) basis input and 0lltput channels increases, the complexity of 

and the scheduler arbitrates among the four requests providing N 2 input queues and sending N 2 requests to the 

received from the four input queues, with a goal of maxi- scheduler becomes costly and difficult to implement, 

mizing utilization of the input channels 12-18 and output In addition t0 the problem of added complexity> the 

channels 20-26 of the switch. As a grant is issued to a 50 output-distributed queue architecture does not easily support 

particular input channel to access a target output channel or mu i ticast requests, which are more common in network 

channels, a new request is accessible by the scheduler in prot0 cols such as ethernet than in network protocols such as 

place of the granted request. ATM. For example, in order to utilize the output-distributed 

A problem known as head-of-line (HOL) blocking is architecture of FIG. 2 to satisfy a multicast request, the cell 

created when one of the requests at the head of a queue line ss that is to be muiticasted must either be replicated into all of 

is a request for an output channel that is not available. HOL tne ou t pu t channel queues that are indicated by the request 

blocking is common when a multicast request (i.e., a request or a separate multicast queue must be established in addition 

for a packet to be simultaneously sent to more than one { 0 me ^ queues already present. 

output channel) is made because there is a lower probability M a resuh of the shortcomings of conventional output- 

that all of the output channels for the multicast request will 6 o distributed queue architecture, what is needed is a method 

be available immediately. When a request from a particular and apparatus that limit the number of input queues ^ the 

input channel is forced to wait until all output channels are complexity of sending requests to a scheduler, while still 

available, all of the packets associated with the particular maintaining fair and efficient scheduling, 
input channel are also forced to wait, thereby slowing the 

transfer of data from that input channel. 65 SUMMARY OF THE INVENTION 

As one remedy to HOL blocking problems, parallel input A method and apparatus for supplying new requests to a 

queues have been implemented in switching arrangements. scheduler in an input-buffered multiport switch involve 
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selecting a request that does not target output channels that 
conflict with output channels targeted by requests that are 
already supplied to the scheduler. Specifically, output chan- 
nels that are presently accessible to the scheduler are iden- 
tified and compared to requested output channels that are 
included in a queue of next-in-line requests. The queue of 
next-in-line requests is reviewed and the highest priority 
request having no conflicting output channels is supplied to 
the scheduler. By supplying the scheduler with a new request 
that targets non-conflicting output channels, the scheduler is 
presented with a wider range of requested output channels 
from which to choose in each arbitration cycle. 

In a preferred embodiment, one, two, or eight ports are 
connected to each of four input/output (I/O) controllers in a 
switch having a four-channel switch fabric. Within each I/O 
controller, the elements involved in supplying new requests 
to the "primary" scheduler include a request queue or 
queues, a queue manager, a secondary scheduler, and a copy 
of the requests that are accessible to the primary scheduler. 
The scheduler is referred to as the primary scheduler in order 
to distinguish it from the secondary scheduler. 

The request queues within each I/O controller relate on a 
one-to-one basis to the ports that are connected to the I/O 
controller. For example, in the case of only one port, all 
requests from that one port are queued in a single request 
queue. Likewise, when eight ports are connected to the I/O 
controller, there are eight separate request queues that store 
requests related to the respective ports. In the preferred 
embodiment, the request queues are time-ordered queues. 

The queue managers within each I/O controller manage 
the transfer of requests between the request queues, the 
primary scheduler, and the secondary scheduler. The queue 
managers also supply a copy of the primary arbitration 
queue to the secondary scheduler for secondary arbitration 
purposes. 

The secondary schedulers are the units that determine 
which requests, from the group of next-in-line requests that 
are stored in the request queues, will be supplied to the 
primary arbitration queue when a new request is needed by 
the primary scheduler. Although all of the secondary sched- 
ulers operate in a similar manner, there are configuration 
differences between the secondary schedulers based on the 
number of ports connected to the I/O controller and the 
number of packet priorities that are supported within the 
switch. The secondary scheduling process is briefly dis- 
cussed in relation to the one-port, two-port, and eight-port 
cases, and it will become apparent to one of ordinary skill in 
the art that similar approaches can be taken when a different 
number of ports are connected to an I/O controller. 

The preferred architecture in an I/O controller which has 
one port connected to the I/O controller and supports a 
packet priority scheme within the switch that is only based 
upon time includes a single request queue containing at least 
twelve requests and a primary arbitration queue containing 
up to four requests. When the primary arbitration queue 
grants a request during the arbitration process, the queue 
must be supplied with a new request. The secondary sched- 
uler arbitrates among the sequence of requests in its request 
queue that begins with the oldest request that is not in the 
primary arbitration queue. The goal of the secondary sched- 
uler is to select the oldest request that is requesting an output 
channel or output channels that do not conflict with the 
output channels that are presently being requested by 
requests held in the primary arbitration queue. The second- 
ary scheduler is in communication with the queue manager, 
which has access to a copy of the output channels that are 
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requested by the primary arbitration queue. The secondary 
scheduler goes through an arbitration process that involves 
comparing the requests in the secondary scheduler to the 
output channels requested in the primary arbitration queue 

s selecting the oldest non-conflicting request. An advantage of 
the arbitration method is that the primary scheduler is 
presented with a more diverse primary arbitration queue 
from which to select packets for transfer through the switch. 
The preferred architecture within an I/O controller for 

10 supplying the scheduler with a new request in the case in 
which two ports are connected to the I/O controller includes 
a request queue for each of the two connected ports and two 
four-deep secondary arbitration queues within the secondary 
scheduler. The secondary arbitration queues contain the 

15 sequence of requests that start with the oldest request that is 
not included in the primary arbitration queue. The sequence 
of four requests from each request queue are interlaced in an 
alternating fashion within the secondary scheduler to create 
a combined secondary arbitration queue that has requests 

20 from both queues, preferably four requests from each queue 
for a total of eight requests. The time relationship is main- 
tained between requests from the same request queue, but 
there is riot necessarily a time relationship between the 
requests of the two queues. 

25 The secondary scheduler arbitrates between the eight 
requests in the combined secondary arbitration queue. The 
secondary scheduler supplies the primary arbitration queue 
with the oldest request that targets output channels that are 
different than the output channels targeted in the primary 

30 arbitration queue. In one difference from the one-port case, 
an arbitration priority is established between the requests 
from the two request queues. The requests from the two 
queues are interlaced such that the oldest request from one 
queue is assigned the highest priority until a request from 

35 that queue is supplied to the primary arbitration queue. The 
higher priority is then switched to the requests from the other 
queue. 

The preferred architecture within an I/O controller for 
supplying the scheduler with a new request in the case in 

40 which eight ports are connected to the I/O controller 
includes eight request queues and one request, preferably the 
oldest request, from each of the eight request queues stored 
within the secondary scheduler. The eight requests stored 
within the secondary scheduler are used to create a com- 

45 bined secondary arbitration queue that contains eight 
requests. The eight requests do not necessarily have a time 
relationship among each other, and they are ordered based 
on their designated port numbers. Arbitration priority among 
the requests of the combined secondary arbitration queue is 

50 determined on a rotating round-robin basis. One port con- 
taining a request is identified by an arbitration pointer as the 
highest arbitration priority until the request associated with 
that port meets the arbitration requirements and is delivered 
to the primary arbitration queue. The arbitration pointer is 

55 advanced to the next valid request in input port order each 
time a highest arbitration priority request is supplied to the 
primary arbitration queue. Hie arbitration process is the 
same as the process used in the one- and two -port cases, in 
that the highest priority request targeting output channels 

60 that do not conflict with output channels targeted by the 
primary arbitration queue is selected to be supplied to the 
primary arbitration queue when a new request is needed by 
the primary arbitration queue. 
The preferred architecture within an I/O controller for 

65 supplying the scheduler with a new request in the case in 
which one port is connected to the I/O controller and the 
switch supports four different packet priority levels includes 
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four request queues, one queue for each of the four different 
^packet priority leve ls. In addition, the secondary scheduler 
maintains an eight-deep request queue for each packet 
priority level. The arbitration approach of the secondary 
scheduler is based on the packet priority of the requests and 
the age of the requests relative to other requests of the same 
packet priority. For example, when a new request is needed 
in the primary arbitration queue, the highest packet priority 
queue in the secondary scheduler that contains requests is 
reviewed first and the oldest non-conflicting request in the 
queue is selected and supplied to the primary arbitration 
queue. If there are no qualifying requests stored in the 
highest priority queue, the primary arbitration queue will not 
be supplied with a new request unless the primary arbitration 
queue is below a minimum request threshold. When the 
highest priority queue contains only conflicting requests, 
lower priority queues are not reviewed in an attempt to 
reserve queue space for the highest priority requests. In 
cases in which there are more than one port connected to the 
I/O controller and more than one packet priority level, the 
arbitration process of the secondary scheduler is similar to 
the case just described and can be easily scaled by one of 
ordinary skill in the art. 

In a preferred embodiment of the invention, a minimum 
request threshold is established for the primary arbitration 
queues. The minimum request threshold is a channel-by- 
channel programmable value that dictates the minimum 
number of requests that should be maintained in the primary 
arbitration queue at any time, as long as there are pending 
requests available. In the preferred embodiment, minimum 
request thresholds of two and four requests are utilized for 
the one and two port and the eight-port channels, respec- 
tively. The minimum request threshold becomes important 
to filling the primary arbitration queue when the number of 
requests in the primary arbitration queue falls below the 
minimum request threshold. When the primary arbitration 
queue falls below the minimum request threshold, the queue 
is filled from the secondary scheduler with the next oldest 
non-conflicting request or the next oldest conflicting request 
if there are no non-conflicting requests available. This 
override of the queuing algorithm is put in place to avoid the 
situation where conflicting requests are not supplied to the 
primary arbitration queue, and because of latency in the 
system, an arbitration cycle is performed without a request 
present. 

As stated above, the primary advantage of the secondary 
arbitration process is that the primary arbitration queue is 
supplied with a new request that targets output channels that 
do not conflict with output channels targeted by requests that 
are already present in the primary arbitration queue. Because 
the primary arbitration queue is supplied with a broader 
distribution of targeted output channels, the primary sched- 
uler will have more channels to select from when scheduling 
packets through the switch which becomes more important 
as the number of channels in the switch fabric increases. By 
providing a broader Output channel distribution within the 
. primary arbitration queue, head-of-line blocking problems 
are minimized. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a diagram of a prior art switch that has four input 
channels and four output channels. 

FIG. 2 is an N input channel by N output channel switch 
with N 2 output-distributed input queues. 

FIG. 3 is a depiction of the transferring of cells from 
output-distributed input queues to output channels where 
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maximum matching between input and output channels is 
achieved using prior art techniques. 

FIG. 4 is a depiction of the transferring of cells from 
output-distributed input queues to output channels where 
s maximum matching between input and output channels is 
not achieved using the prior art techniques. 

FIG. 5 is a diagram of the switch fabric architecture in 
accordance with the present invention. 
10 FIG. 6 is a diagram of a data packet and an expanded 
switching cell that is transmitted through the switch fabric of 
FIG. 5. 

FIG. 7 is an expanded diagram of a channel module as 
shown in FIG. 5. 
35 FIG. 8 is an expanded diagram of the scheduler as shown 
in FIG. 5. 

FIG. 9 is an example matrix of requests from switch input 
channels 0 through 3 at packet priority levels 0 through 3. 
FIG. 1 OA is an example of the level 1 mask generation for 
20 the requests at level 1 in FIG. 9. 

FIG. 10B is an example of the level 2 mask generation for 
the requests at level 2 in FIG. 9. 

FIG. IOC is an example of the level 3 mask generation for 
25 the requests at level 3 in FIG. 9. 

FIG. 11 A is an example of the mask compare process for 
a request shown in FIG. 9. 

FIG. 11B is an example of the mask compare process for 
a request shown in FIG. 9. 
30 FIG. 12 is an example of the level-specific sub-scheduling 
process for the requests related to FIGS. 9 and 11B. 

FIG. 13 is a diagram of the preferred N-channel multi- 
priority scheduler architecture for the scheduler shown in 
35 FIGS. 5 and 6. 

FIG. 14 is a depiction of the preferred multi-level 
in-parallel arbitration process for an NxN switch with M 
packet priority levels in accordance with the invention. 
FIG. 15 is a depiction of the preferred multi-level 
40 in-parallel arbitration process for a 16x16 switch with four 
packet priority levels in accordance with the invention. 

FIG. 16 is a diagram of an alternative single level, single 
channel arbitration process for an NxN switch with M 
packet priority levels in accordance with the invention. 
45 FIG. 17 is a depiction of a preferred architecture for 
supplying a scheduler with new requests in accordance with 
the invention. 

FIG. 18 is a depiction of a preferred architecture within an 
I/O controller for supplying new requests to a scheduler 
50 where one port is connected to the I/O controller in accor- 
dance with the invention. 

FIG. 19 is an example of the arbitration process for 
supplying a new request to a scheduler using the architecture 
of FIG. 18 in accordance with the invention. 

FIG. 20 is a flow diagram of a method for supplying a 
scheduler with a new request in accordance with the inven- 
tion. 

FIG. 21 is a depiction of a preferred architecture within an 
60 I/O controller for supplying new requests to a scheduler 
where two ports are connected to the I/O controller in 
accordance with the invention. 

FIG. 22 is an example of an arbitration process for 
supplying a new request to a scheduler using the architecture 
65 of FIG. 21 in accordance with the invention. 

FIG. 23 is a depiction of a preferred architecture within an 
I/O controller for supplying new requests to a scheduler 
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where eight ports are connected to the I/O controller in FIG. 7 is an expanded diagram of an example channel 

accordance with the invention. module N 11.8. The channel module of FIG. 7 has a request 

FIG. 24 is an example of the arbitration process for buffcr 128 that can store M rec l ucsts U ®> 162 > 164 > 166 

supplying a new request to a scheduler using the architecture M request registers and that can provide M requests to a 

of FIG. 22 in accordance with the invention. s scheduler m pandkl- In the preferred 16x16 switch, M is 

equal to 4. That is, there can be up to four requests stored in 

FIG. 25 is a depiction of a preferred architecture within an each of sixteen request bllffers for a total of g^ty-four 

I/O controller for supplying new requests to a scheduler requests. With one buffer per channel and four request 

where one port is connected to the I/O controller and the I/O registers per buffer, a 16x16 switch has only sixteen buffers 

controller supports four packet priority levels in accordance ^ provides only sixty-four requests to a scheduler per 

with the invention. arbitration cycle, in comparison to a conventional 16x16 

FIG. 26 is a depiction of a preferred architecture within an switch with output-distributed queues which would require 

I/O controller for supplying new requests to a scheduler N 2 , or 256, request buffers and would provide N 2 , or 256, 

where two ports are connected to the I/O controller and the requests to a scheduler per arbitration cycle. 

I/O controller supports four packet priority levels in accor- 15 The request buffers 122-128 of FIG. 5 and 7 are filled 

dance with the invention. from the IPPs 92-98 in different manners, depending on 

nnTATT cn ncQrniPTrnM what P acket P rioritv scheme is being implemented in the 

UblAlLbU UbbCKlFllUW switch If the packet priority scri eme within the channel 

FIG. 5 is a diagram of a preferred embodiment of a switch module request buffer is based upon time, where the oldest 

that is to be utilized in conjunction with the invention. For 20 request has the highest packet priority, then the channel 

diagram purposes a 4x4 version of an NxN multiport switch module request buffer is filled on a FIFO basis. In FIG. 7, the 

fabric 60 is depicted, although a 16x16 switch fabric is request buffer 128 for channel N has four request register 

preferred. In the preferred embodiment, the input channels designations 160, 162, 164 and 166 from bottom to top, level 

62, 64, 66 and 68 and output channels 72, 74, 76 and 78 are 0 (L0), level 1 (LI), level 2 (L2), and level M (LM), where 

combined into packet processing units 82, 84, 86 and 88 that 25 register L0 is the highest priority and register LM is the 

include input packet processors (IPPs) 92, 94, 96 and 98, and lowest priority. In this packet priority scheme, register L0 

output packet processors (OPPs) 102, 104, 106 and 108. The contains the oldest request and register LM contains the 

IPPs segment incoming variable-sized packets into fixed- newest request. Whenever a grant is issued in response to a 

length switching cells and may buffer the cells before they request, the request buffer adjusts on a FIFO basis, thereby 

are switched. Packets arriving at the IPPs can range in size, 30 leaving a vacant request register at the lowest priority, LM. 

and may reach a size of thousands of bytes. The IPPs The vacant request register 166 is then available to receive 

segment the packets into 36-byte fixed-length switching a new request from the IPP 98. 

cells. On the other hand, the packet priority scheme may be 

Referring to FIG. 6, each 36-byte switching cell 140 based upon a factor other than time. For example, the packet 

consists of a 4-byte command cell 142 and a 32-byte data 35 priority scheme may be based upon the source of the data or 

cell 144. Using 16-bit channels, each switching cell is sent the type of data. Under such a packet priority scheme, the 

through the switch over eighteen clocks and a framing pulse four registers 160-166 in the request buffer 128 can be 

146 is used to indicate the termination of one switching cell identified, for example, as control, high, medium, and low 

and the beginning of an adjacent switching cell. Each priority, with control being the highest packet priority (i.e., 

command cell consists of two command fields. The first 40 L°) ™ d l° w beill g tne lowest packet priority (i.e., LM). 

command field contains a request or response that is used to When a request is granted under this scheme, the vacant 

exchange messages related to switching arbitration. The request register is resupplied with a request having the same 

second command field contains a data identifier that carries packet priority level as the request for which a grant was just 

information relating to the data cell in the current switching issued. 

cell. The data cell carries the data that is a part of a larger 45 In an embodiment of the switch that is the focus of the 

packet 150 from which the switching cell was segmented. present invention, the IPPs/OPPs function as part of an 

After the switching cells pass through the data path input/output control system to supply the vacant request 

multiplexer, the data cell portions of the switching cells are registers with new requests in a priority scheme that 

reassembled into variable-length packets by the OPPs for increases the probability that all of the channels in the switch 

transmission within the network. 50 fabric will be utilized during a given arbitration cycle. The 

Referring back to FIG. 5, switching cells are transmitted supplying of new requests to the request buffers will be 

between the IPPs/OPPs 92-98 and 102-108 and the corre- discussed in detail with reference to FIGS. 17-26, after the 

sponding channel modules 112, 114, 116 and 118. The description of the primary scheduling architecture and algo- 

channel modules execute a synchronization protocol for rithms. 

each channel, perform a cyclic redundancy check (CRC) for 55 FIG. 7 also depicts the specific input and output links 

incoming requests, and generate a CRC for outgoing associated with each channel module, using channel N as an 

acknowledge messages. The channel modules are also example. The data__in and data__out links located at the top 

responsible for routing the command and data cells to the of the channel module 118 are used to transport command 

proper locations within the switch. For efficiency purposes, cells, data cells, grants and level selects between the channel 

the command cells that are transmitted between the channel 60 module and the IPP/OPP. The input grant link (IGRANT_ 

modules and the IPPs/OPPs may be piggybacked onto data CHN) and level select link (LEVEL_SEL) located at the 

cells to form complete 36-byte switching cells, even though right side of the channel module are used to transport the 

some of the information in the command cells may not be IGRANT_CHN signal and LEVEL__SEL signal from the 

directly related to the data in the data cells they are traveling scheduler to the channel module. The IGRANT_CHN sig- 

with. The channel modules demultiplex the command cells 65 nal represents an input grant that has been issued by the 

from the data cells and write the request portions of the scheduler for channel N. The LEVEL_SEL signal repre- 

command cells to a request buffer. sents the packet priority level that corresponds to the 
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IGRANT__CHN signal. For example, the LEVEL_SEL 
signal will identify one of the levels LO through LM corre- 
sponding to a CHN grant. 

The channel N request links level 0 through level M 
(RQ_CHN_L0 through RQ_CHN_LM) and the done link 
(DONE__CHN) located at the bottom right of the channel 
module 118 are used to transport the channel requests and a 
done signal to the scheduler The M request links are routed 
to the scheduler in parallel and provide the M requests to the 
scheduler simultaneously. As will be discussed further, pro- 
viding parallel delivery of M requests helps to minimize the 
HOL blocking problem discussed above. The request links 
in the preferred 16x16 switch are 16-bit channels that carry 
requests that include a 16 -bit crossbar exit channel descrip- 
tor (CEP). The 16-bit CEP has one bit associated with each 
output channel, and the desired output channels are identi- 
fied by setting the bits that correspond to the output chan- 
nels. 

The DONE_CHN signal indicates to the scheduler when 
the input channel has completed transmitting the current 
group of switching cells. Switching cells that are segmented 
from the same packet are ideally transmitted one after 
another Since packets are variable length and are therefore 
made up of a variable number of switching cells, it is 
preferred that the scheduler be informed when an input 
channel has completed transferring of a group of switching 
cells. The DONE_CHN signal is also used to determine 
which output channels have become available to receive 
switching cells. Determining available output channels from 
a DONE_CHN signal that indicates the availability of an 
input channel is accomplished through a look-up table. A 
look-up table is updated each time a grant is issued to an 
input channel. The look-up table identifies which output 
channels will be utilized by the input channel for the granted 
cell transfer. When a DONE_CHN signal is received by the 
scheduler, the look-up table for the corresponding input 
channel is accessed and the identified output channels in the 
look-up table are released and made available for future 
switching. 

The data to and from the multiplexer links (data to mux 
and data„_from__mux) and the multiplexer setup link (mux 
set) located at the bottom left of the channel module 118 are 
used to transfer data cells to and from the multiplexer and to 
set up the data paths within the multiplexer for the transfer 
of switching cells. 

Although not represented, the channel module 118 also 
performs a time-out function to limit the amount of time and 
therefore the number of cells that can be transferred unin- 
terrupted by a single input/output channel combination. 
Every time a grant is issued to an input channel, a timeout 
counter in the corresponding channel module is set to the 
timeout value. During every successive clock cycle, the 
timeout counter is decremented and if the input channel 
cannot complete the transfer within the timeout period, the 
timeout counter expires and the transfer is terminated. In the 
preferred embodiment, the timeout counters in the channel 
modules are set to allow up to 4,096-byte packets to be 
switched in one uninterrupted event. 

Referring back to FIG. 5, the channel modules 112-118 
are connected to a data path multiplexer 130 that provides 
the physical paths for data cell switching between channels. 
The preferred data path multiplexer has the ability to unicast 
data cells and to multicast data cells. In the preferred 
embodiment, the data path multiplexer is a multiport switch, 
although in another embodiment the data path multiplexer 
can be a crossbar switch. The type of data path multiplexer 
is not critical to the invention. 
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The channel modules 112-118 are also connected to a 
scheduler 132. The scheduler utilizes the requests from the 
channel modules to manage the cell traffic through the data 
path multiplexer in a manner that maximizes the throughput 
of switching cells without unfairly delaying lower priority 
data. 

FIG. 8 is an expanded view of the scheduler 132. The 
scheduler is first described in terms of the input and output 
links and then in terms of the functional blocks within the 
scheduler that operate to generate the output signals. 
Located along the top of the scheduler, request links and 
done signal links are connected to the scheduler for receiv- 
ing requests and done signals from the channel modules as 
depicted in FIG. 7. Each channel has M parallel request links 
between the channel modules and the scheduler and in the 
preferred embodiment there are four parallel request links 
per channel. The highest packet priority request link is 
identified as, for example, RQ__CH0_JJ), where "RQ" is 
short for request, "CH0" is short for channel 0, and "L0" is 
short for packet priority level 0. As described above, each 
request link consists of 16-bit channels where a 16 -bit field 
is delivered to the scheduler in a single clock. The DONE__ 
CH0 signal is received from the channel module and indi- 
cates when an input is available and what corresponding 
outputs are available. 

The output links located along the bottom of the scheduler 
include a grant link for each channel and a level select link. 
As described with reference to the channel modules, the 
grant links transmit the IGRANT_CHN signals generated 
within the scheduler to the channel modules to indicate that 
a request from a particular channel has been granted. The 
LEVEL__SEL link transmits a LEVEL_SEL signal to the 
channel module along with each grant to indicate the packet 
priority level of the granted request. For example, if a 
request is granted to channel N, the LEVEL__SEL signal 
indicates to channel module N the particular packet priority 
level of the request. 

The functional blocks within the scheduler depicted in 
FIG. 8 include a mask generator unit 170, a mask compare 
unit 172, a level-specific scheduling unit 174, a priority 
encoder unit 176, and a resource management unit 178. The 
mask generator unit is a circuit that generates packet priority 
level-specific masks that are utilized in the arbitration pro- 
cess to indicate which output channels will be utilized by the 
input channels for a specific packet priority level. In the 
preferred 16-16 switch, a level -specific mask consists of a 
16-bit vector where each bit is dedicated to one of the output 
channels. A level-specific mask is generated by combining 
all of the request vectors from the request channels 0-15 for 
the same packet priority level to form a single mask vector 
that represents all of the requests. 

In an example related to the NxN switch of FIG. 5, masks 
are generated from the requests of input channels 0-3, 
CH0— CH3, having packet priority levels 1 through 3, 
L1-L3. The channels 0-3 are the input channels 62-68, 
respectively. For example purposes, FIG. 9 represents the 
requests from channels CH0-CH3 at packet priority levels 
L0-L3. FIGS. 10A-10C represent the mask generation for 
the L1_MASK, the L2_MASK and the L3„MASK. The 
L1_MASK is generated from the aggregate of the requests 
for channels CH0 through CH3 at packet priority level L0. 
The mask, represented in FIG. lOAas Ll_JvlASK, has a bit 
set to "1" at any place where an L0 request for any channel 
was set to " 1 ." The end result is that the mask represents all 
outputs that are requested by the stored requests that are 
designated as having the highest packet priority levels. As 
depicted in FIGS. 10B and 10C, the L2 and L3 masks are 
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generated by building on the lower level masks in the same 
manner. The highest packet priority level mask, L0_MASK 
(not shown), is generated by simply copying the highest 
packet priority request that is related to the channel with the 
highest round-robin priority designation. Round-robin pri- 
ority refers to a priority scheme among channels that is used 
in the arbitration process and will be discussed further 
below. Preferably, all of the masks are regenerated once 
before each eighteen clock arbitration cycle, but the masks 
can be regenerated every clock, if desired. The algorithms 
for creating four masks for an NXN switch are as follows: 
LO„MASK=RQ„CHX„LO, where CHX is the channel 

with the "high priority" designation 
L1_MASK-(RQ_CH0_L0)|(RQ_CH1_L0)| . . . (RCL_ 

CHN_L0) 

L2_MASK=L1_MASK|(RQ_CH0_L1)|(RQ_CH0„ 
Lj)| . . . (RQ_CHNL_L1) 

L3_MASK=-L2_MASK|(RQ_CH0„L2)|(RQ_CH1_ 
L2)| . . . (RQ_CHN_L2) 
In the operation of the LI, L2, and L3 masks, requests from 
input channels which are unavailable are not included in the 
mask generation algorithm. 

The next functional block in FIG. 8 is the mask compare 
unit 172. The mask compare unit is a circuit that compares 
level-specific masks to the availability of the input channels 
and to the requests from the corresponding priority level, 
while monitoring for conflicts between available inputs, 
requested outputs, and the mask. The availability of inputs 
is represented by an input vector (IVEC) that is an N bit 
vector where N equals the number of input channels in the 
switch. In the 4x4 switch example, the IVEC is a 4-bit vector 
with unavailable input channels having a corresponding bit 
set to "1." Referring to FIGS. 11A and 11B, examples of the 
mask compare process are depicted. In the example of FIG, 
11A, the request used, RQ_CH1_L1, is taken from FIG. 9 
and includes the 4-bit request vector "0010." The input 
vector, IVEC, is exemplary and is the 4-bit vector "0100," 
representing that input channel 1 is unavailable or busy. 
Since the unavailable input channel is the same as the input 
channel making the request, the request cannot be granted to 
the busy channel and all request bits are set to "0." The 
resulting request is compared to the L1_MASK, which 
represents the higher priority output channel requests from 
LO. Since the resulting RQ_CH1_L1 is the 4-bit vector 
"0000," a request for zero output channels is passed on to the 
level-specific scheduling unit. 

In the example of FIG. 11B, request RQ_CH2_L1 is 
taken from FIG. 9 and is the 4-bit request vector "0010." The 
input vector is exemplary and is the same 4-bit vector 
"0100" as used in the previous example. Since the input 
vector indicates that only input channel 1 is unavailable and 
the request is from input channel 2, the resulting request 
vector remains "0010." The L1_MASK vector is again 
"1001" which represents that output channels 0 and 3 have 
been or will be requested by higher priority requests for 
output channels. The L1_MASK does not conflict with the 
request and as a result, the scheduler will pass on 
RQ_CH2_L1 as the vector "0010." 

Referring back to FIG. 8, the next functional block is the 
level -specific scheduling unit 174. The level-specific sched- 
uling unit is a circuit that contains a level-specific sub- 
scheduler for each packet priority level. In the preferred 
embodiment of the 16x16 switch, there are four packet 
priority levels and therefore four level-specific sub- 
schedulers. The level-specific sub -schedulers receive the 
level -specific requests that are output from the mask com- 
pare unit 172 and compare input and output vectors to the 
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requesting channel and to the request vector to determine if 
channel conflicts exist. 

If no channel conflicts exist between the input vector, 
output vector, requesting channel, and request vector, a grant 
s is issued and the input and output vectors are set to reflect 
the new grant. 

The level-specific sub-scheduling units utilize a round- 
robin arbitration scheme to guarantee fairness among 
requests of the same priority level. Under the round-robin 

10 scheme, initially, channel 0 is designated as having the 
highest round-robin channel priority and channel 15 is 
designated as having the lowest round-robin priority. Note 
that round-robin priority is relevant to the channel priority 
order inside the level-specific sub-schedulers and is different 

is from the packet priority, which is relevant to the order in 
which requests are presented from channel modules. Inside 
the level-specific sub-schedulers, requests are processed 
between channels in round-robin priority order such that 
requests from channels with higher round-robin priority are 

20 granted access to output channels whenever there is conten- 
tion with requests from channels with lower round-robin 
priority. Once the channel with the highest round-robin 
priority receives a grant, the highest round-robin priority 
designation is rotated to the next input channel with a 

25 pending request. Under the rotating round-robin channel 
priority approach, every channel will periodically be desig- 
nated as the highest priority. 

High round-robin priority designation plays an especially 
important role in allowing multicast transmissions through a 

30 switch. Multicast requests are difficult to schedule in high- 
trafEc environments, because the likelihood that all output 
channels are available is low. To guarantee bounded latency 
for multicast and broadcast traffic, when a channel is des- 
ignated as the highest round-robin priority, any output 

35 channels requested by the channel will be reserved by the 
scheduler, unless the output channels are required by 
requests from other channels with higher packet priority 
until all of the output channels required to grant the request 
become available, 

40 An example of the level-specific sub-scheduling process 
is depicted in FIG. 12 for one packet priority level. For the 
example, assume that channel 2 has the highest round-robin 
priority. The example is a continuation of the example of 
FIG. UB. In FIG. 12, the input vector is still "0100," the 

45 exemplary output vector is "0001," and the request 
RQ_CH2_L1 is "0010." The input vector indicates that 
input channel 1 is busy and the output vector indicates that 
output channel 3 is busy. The request RQ_CH2_L1 is for 
input channel 2 to transmit a cell to output channel 2, neither 

50 of which conflicts with the input vector or output vector. 
Since no conflicts exist between the request, the requesting 
channel, the input vector, and the output vector, a grant with 
vector "0010" is issued for CH2_L1. Along with the grant, 
the level-specific sub-scheduling unit also generates updated 

55 input and output vectors that represent the IVEC and the 
OVEC that will be utilized if the request is granted. The 
updated input vector and output vector are identified as 
IVEC_NEXT__L1 and OVEC_NEXT__Ll . In the 
example, IVEC will change from "0100" to "0110" to 

60 signify that input channel 2 will also be busy and OVEC will 
change from "0001" to "0011" to indicate that output 
channel 2 will also be busy. 

Referring back to FIG, 8, the next functional block is the 
priority encoder unit 176. The priority encoder unit is a 

65 circuit that is responsible for implementing the packet 
priority order and issuing the final grants to the channel 
modules. When there are one or more possible grants 
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transmitted to the priority encoder unit from the four Level- 
specific sub-schedulers in the current scheduling cycle, the 
priority eucoder unit picks the grant corresponding to the 
request with the highest packet priority and passes the grant 
on to the requesting channel module. The priority encoder 
unit also sends the updated values of the input and output 
channel utilization to the resource management unit to 
update IVEC and OVEC. 

Referring back to FIG. 8, the resource management unit 
178 is responsible for maintaining the status of the input and 
output vectors IVEC and OVEC, respectively. Every time a 
grant is issued, the input vector bit related to the input 
channel that received the grant and the output vector bit 
related to the output channels that are going to be used in the 
packet transfer are marked as busy. When the end of a packet 
transfer is signaled by the channel module using a done 
signal, the respective input vector bits and output vector bits 
marked during the transfer are cleared so that the channels 
can be scheduled for another transfer. 

FIG. 13 is a diagram of the preferred N-channel multi- 
priority scheduler architecture that includes the mask gen- 
erator unit 190, mask compare sub-units 192, 194, 196 and 
198, the level-specific sub-scheduling units 202, 204, 206 
and 208, the priority encoder unit 210, and the resource 
management unit 230. The preferred architecture reflects a 
scheduler where M, the number of packet priority levels and 
request buffer registers per channel, is equal to 4. Following 
a logical flow, a request, for example, RQ_CH0_L0 enters 
a mask compare sub-unit 192 at the request input (Rl). The 
level 0 mask enters the mask compare sub-unit at MSK and 
an input vector, IVEC, enters at INP_BSY. The vectors are 
compared as described above, and a request is output from 
the request output (R0) to an N:l multiplexer 212. The N:l 
multiplexer designates the request as high priority where 
applicable and forwards the request to a sub-scheduling unit 
202 of the level -specific scheduling unit for L0. The input 
vector, IVEC, and an output vector, OVEC, are input into the 
level -specific sub-scheduling unit from the resource man- 
agement unit along with the request for channel 0 at level 0, 
RQ__CH0_L0 from the mask compare sub-unit. 

A grant is issued from the level-specific sub -scheduling 
units 202-208 based on the availability of input channels 
and output channels and the round-robin priority as 
described above. The updated input and output vectors are 
sent to respective multiplexers as IVEC„NEXT__L0 and 
OVEC_NEXT_L0, while the grant is sent to the priority 
encoder unit as IGRANT_L0. 

The priority encoder unit 210 receives four grants from 
the four level-specific sub-scheduling units 202-208 for 
each channel. A single grant for a single channel is issued by 
the priority encoder unit based on packet priority level. That 
is, the grant with the highest packet priority level is selected 
among the four available grants and, therefore, if there is a 
grant for an output channel from level 0, it has priority over 
all other packet priority levels for the channel. Similarly, if 
there are no grants for packet priority levels LO and LI, but 
there are grants for packet priority levels L2 and L3, then the 
L2 grant is issued and the L3 grant must wait for a later 
arbitration cycle. 

If a grant is issued to the high priority channel, then the 
high priority designation is shifted to the next channel. The 
preferred channel priority architecture 230 is depicted in 
FIG. 13. After being processed through the priority encoder 
unit, the grant issued based on packet priority level is 
transmitted to the corresponding channel module accompa- 
nied by a level select signal that identifies which packet 
priority level the request relates to and where in the request 
buffer the request is located. 
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Although the functions of the overall scheduler unit have 
been specifically described, it is important to note that the 
functions may be performed in different orders. For 
example, it is possible to perform the level-specific sub- 

5 scheduling function before the mask compare function. In 
addition, the process of accounting for input and output 
channel availability as performed by the resource manage- 
ment unit may differ. Further, the physical boundaries may 
vary from those described. For example, certain functions 
such as mask generation may be performed outside the 
physical boundaries of the scheduler. 

The preferred arbitration method is further explained with 
reference to FIG. 14, which graphically represents buffered 
requests from an N-channel multiport switch. The channel 
modules have the ability to buffer M requests in their 

]5 respective buffers with a packet priority designation that 
ranges from a highest packet priority at level 0, L0, to a 
lowest packet priority at level M, LM. In the preferred 
embodiment, N is 16, indicating sixteen channels 
CH0-CH15 and M is 4, indicating four request storage 

20 registers and four corresponding packet priority levels 
L0-L3 related to each channel for a total of 4x16=64 request 
buffer registers. 

In the preferred arbitration method, packet priority refers 
to the priority level of one buffered request for a channel 

25 versus another buffered request for the same channel. Time 
is used as the packet priority basis in this embodiment and 
under the time approach L0 contains the oldest request in the 
buffer and has the highest packet priority. Levels 1, 2, and 3 
contain sequentially newer requests and have sequentially 

30 lower packet priority. Round-robin priority refers to the 
channel that is designated as high round-robin priority under 
the rotating round-robin channel priority scheme. As 
described above, once a channel is designated as high 
round-robin priority, the channel maintains the designation 

35 for successive arbitration cycles until a grant is issued for the 
channel. Round-robin priority after the high priority channel 
is distributed sequentially (i.e., from channel 0 to 15 and 
then back to channel 0) such that each sequential channel has 
a lower round-robin priority. For example, if CH13 is the 

40 highest round-robin priority channel, CH14 is the next 
highest round-robin priority, CHI 5 is the next highest round- 
robin priority, and CHO is the next highest round-robin 
priority, with the pattern continuing until CH12, which is the 
lowest round-robin priority channel. 

45 With the priority protocol established, the preferred mul- 
tilevel in-parallel arbitration (MLIPA) process is described 
with reference to FIG. 15. 

In the example, it is assumed that L0 is designated high 
packet priority and channel 0 has the highest round-robin 

50 priority. Therefore, in the first clock, phase 1, the four 
requests, L0-L3, for CHO are arbitrated as described above. 
Simultaneously, the L0-L3 requests are processed through 
the mask compare unit, the level-specific scheduling unit, 
and the priority encoder unit. 

55 Out of the parallel process, one request from one of the 
four packet priority levels will be granted. Remembering 
that CHO is the highest priority channel, it is likely that the 
CH0_L0 request will receive the grant even if it is a 
multicast request that requires available output channels to 

60 be reserved while unavailable output channels become avail- 
able. 

In the next clock, phase 2, the four requests, L0-L3, for 
CHI are arbitrated as described above. The arbitration of the 
four requests is performed in parallel and, if possible, one 
65 request is issued for the channel. 

In the next clock, phase 3, the four requests, L0-L3, for 
CH2 are arbitrated as described above. As can be seen, the 
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arbitration continues for sixteen clocks and at the end of IPPs 92-98 and OPPs 102-108 are incorporated into I/O 

sixteen clocks sixty-four requests have been arbitrated and controllers 242, 244, 246 and 248 and are not shown. It 

grants have been issued in a manner that maximizes input should be understood that the functions to be described can 

channel and output channel utilization. be partially performed within the IPPs/OPPs or the functions 

A complete arbitration cycle requires eighteen clocks, two 5 can be performed in additional circuitry and programming 

clocks for arbitration preparation and sixteen clocks for that make up the I/O controllers. As described above, the 

arbitration. The sixteen clocks that are required to arbitrate switch is depicted as having a four-channel switch fabric, 

the sixty-four requests are synchronized to the sixteen clocks but the switch fabric can have more or less than four 

that are required to transmit the data cell portion of a channels. In addition, for description purposes, the I/O 

switching cell, as described with reference to FIG. 6. Before 10 controllers are shown connected to one, two, or eight ports 

a new sixteen clock arbitration process begins, and during as opposed to the switch of FIG, 5 in which each channel is 

the two clocks required to transmit the command cell portion described in terms of a single port. In a preferred 

of the next switching cell, preparations are made for the next embodiment, the one- and two -port configurations represent 

arbitration process. In the first clock, all of the done signals 1000 megabits per second (Mbps) connections to the switch 

are reviewed and the channels that have become available is and the eight-port configuration represents 10 and/or 100 

during the preceding arbitration cycle are released by clear- Mbps connections. 

ing the appropriate input vectors and output vectors. Within each I/O controller 242-248, the elements of 

Additionally, in the first clock the request buffers are replen- importance to the preferred embodiment of the invention are 

ished to fill request registers vacated by the requests that a request queue or queues 252, 254, 256 and 258, queue 

were granted in the last arbitration cycle. In the second and 20 managers 262, 264, 266 and 268, secondary schedulers 272, 

last clock before the next arbitration begins, new masks, that 274, 276 and 278, and copies of the requests that are 

reflect the newly replenished buffers, are generated for the accessible to the main scheduler (referred to as the primary 

four packet priority levels and the round-robin priority is arbitration queues). The main scheduler is referred to as the 

rotated if the highest round-robin priority channel received primary scheduler 132 in order to distinguish it from the 

a grant in the last arbitration cycle. 25 secondary schedulers. Referring to FIG. 17, the primary 

In an alternative arbitration method, the requests in the arbitration queue for each channel is depicted in three 
request buffers can be arbitrated one request at a time, one places. The primary arbitration queue actually resides in the 
packet priority level at a time, as depicted in FIG. 16. In the request buffers 122, 124, 126 and 128 of the channel 
preferred embodiment where N=16 and M=4, the arbitration modules 112-118, so that the requests are accessible to the 
process would arbitrate sixty-four requests in sixty-four 30 primary scheduler. Copies 282, 284, 286 and 288 of the 
clocks. The arbitration would start at the highest round-robin primary arbitration queue are also kept or utilized in the I/O 
priority and highest packet priority request, for example, controllers and a composite copy 131 is formed in the 
RQ _CH0_L0. Phase 1 requires sixteen clocks, phase 2 primary scheduler for arbitration purposes. In addition to the 
requires sixteen clocks, phase 3 requires sixteen clocks, and named elements of importance, the I/O controllers may 
phase 4 requires sixteen clocks for a total of sixty-four 35 include other devices and/or functions, such as port control- 
clocks. Grants are issued on a first request-first grant basis lers and packet buffers that are not depicted, 
with the round -robin priority rotating each arbitration cycle The request queues 252-258 depicted within each I/O 
as described above. An advantage of this approach is the controller 242-248 relate on a one-to-one basis to the ports 
simplicity found in the fact that mask generation, mask 292, 294, 296 and 298 that are connected to the I/O 
comparing, and parallel arbitration are not being performed. 40 controller. For example, in the case of only one port, all 
A disadvantage is that one arbitration cycle takes sixty-four requests from the one port are queued in a single request 
clocks as opposed to eighteen clocks per cycle for the queue. Likewise, when eight ports are connected to the I/O 
arbitration method described above. controller, there are eight separate request queues that store 

As briefly cited above and in accordance with the present requests related to the respective ports. In the preferred 

invention, the IPPs/OPPs function as part of an input/output 45 embodiment, the request queues are time-ordered queues, 

control system to supply the vacant request registers in the For description purposes, in all of the request queues, the 

channel module request buffers with new requests in a oldest request is depicted at the bottom of the queue and the 

priority scheme that increases the probability that the maxi- youngest request is depicted at the top of the queue, although 

mum number of switch fabric output channels will be this is not critical to the invention. The request queues within 

utilized during any given arbitration cycle. Specifically, the 50 each I/O controller are shown to represent twelve requests 

probability that a given output channel will be utilized is stored in each queue, although the queues may store less and 

increased by configuring input/output (I/O) controllers to preferably store more than twelve requests per port, 

supply new requests to the scheduler that are requesting The queue managers 262-268 within the I/O controllers 

output channels that do not conflict with requests for output manage the transfer of requests between the request queues 

channels that are presently being held in the channel module 55 252-258 and the channel modules 112-118/primary sched- 

request buffers. That is, the channel module request buffers uler 132. The queue managers also supply a copy of the 

are supplied with new requests that provide a more varied primary arbitration queue to the secondary schedulers for 

distribution of target output channels, so that the scheduler secondary arbitration purposes. The queue managers are 

has more output channel options from which to choose preferably located within the IPPs, although this not critical, 

during each arbitration cycle. This approach to supplying the 60 The secondary schedulers 272-278 are the units that 

channel module request buffers helps to remedy a head-of- arbitrate which requests, from the group of requests that are 

line blocking problem that can occur when the first three stored in the request queues 252-258, will be supplied to the 

requests in a channel module request buffer are held up by primary arbitration queue when a new request is needed for 

other higher priority packet transfers. the primary scheduler 132. Although all of the secondary 

FIG. 17 is a depiction of a preferred architecture for 65 schedulers operate in a similar manner, there are configu- 

supplying the scheduler with new requests. FIG. 17 is ration differences between the secondary schedulers based 

similar to FIG. 5 except that, for description purposes, the on the numbers of ports connected to the I/O controller and 
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the number of packet priorities that are supported within the and 18, which is in communication with the primary arbi- 

switch. The secondary scheduling process is discussed in tration queue. The secondary scheduler goes through an 

relation to the one -port, two -port, and eight-port cases and it arbitration process that involves comparing the requests in 

will become apparent to one of ordinary skill in the art that the secondary scheduler to the output channels requested in 

similar approaches can be taken when different numbers of 5 the primary arbitration queue. 

ports are connected to an I/O controller. In the example of FIG. 19, the secondary scheduler 272 
FIG. 18 is a depiction of a preferred architecture within an first compares the oldest request in the secondary arbitration 
I/O controller that has one port connected to the I/O con- queue 302 (which identifies output channel 0) to the primary 
trailer and supports a packet priority scheme that is only arbitration queue 282. Since there is a conflict at output 
based upon time. The request queue 252 is depicted as 10 channel 0, the oldest request is bypassed. The next youngest 
containing space for twelve time-ordered requests (where A request (which identifies output channels 1 and 3) is then 
is the oldest request and L is the youngest request) and the compared to the primary arbitration queue and there is a 
copy of the primary arbitration queue 282 contains space for conflict at both output channels 1 and 3. The next youngest 
four requests. The four request spaces in the primary arbi- request (which identifies output channel 1) is then compared 
tration queue are designated by the queue depth "x." The 15 to the primary arbitration queue and there is a conflict at 
secondary scheduler arbitrates among "y" requests, where output channel 1, Finally, the next youngest request identi- 
"y" is preferably 8. The "y" requests considered by the fies output channel 2, which does not conflict with any of the 
secondary scheduler include the sequence of requests from output channels requested in the primary arbitration queue, 
the request queue 252 that begins with the oldest request that Since the request is the oldest request that does not identify 
is not in the primary arbitration queue. 20 a conflicting output channel, the request is supplied to the 
For example purposes, it is assumed that the request primary scheduler as the new request, and as a result, the 
queue 252 contains the time-ordered request sequence A newly supplied primary arbitration queue has a distribution 
through L and the primary arbitration queue 282 contains of output channels (channels 0, 1,2, and 3) that increases the 
requests A, B, and E. As stated, the secondary scheduler chances that some or all of the output channels will be 
arbitrates among a sequence of eight requests from the 25 utilized in the next arbitration cycle, 
request queue 252, beginning with the oldest request that is FIG. 20 is a depiction of the preferred method for sup- 
not contained in the primary arbitration queue. Referring to plying requests to a primary scheduler of a multiport switch, 
the secondary scheduler 272, the eight, or "y/' requests Step 360 involves maintaining a queue of output channel 
include the sequence of requests from C through J. Request requests that are not accessible by the scheduler. Step 362 
E is included in the secondary scheduler even though it is 30 involves determining which output channels are being tar- 
already contained in the primary arbitration queue. Request geted by output channel requests that are accessible by the 
E was previously supplied to the primary arbitration queue scheduler. Step 364 involves determining a highest priority 
by the secondary scheduler because higher priority requests request maintained in the queue that is targeting an output 
(i.e., requests C and D) had conflicting output channel channel or channels that is or are not the same as an output 
requests, while E did not have any output channel conflicts. 35 channel targeted by the output channel requests that are 
Request E is maintained in the secondary scheduler queue in accessible by the scheduler. When the primary scheduler is 
an invalid state (so that it is not selected again) until there are available to access a new output channel request, step 366 
no longer any older requests pending in the primary arbi- involves making the highest priority request accessible by 
tration queue, at which point the secondary scheduler queue the scheduler. 

is advanced and request E is removed. The secondary 40 In a preferred embodiment of the invention, a minimum 

scheduler can be designed to eliminate requests such as E request threshold is established for the primary arbitration 

that are already contained in the primary arbitration queue, queues. The minimum request threshold dictates the mini- 

however including the redundant requests in the secondary mum number of requests that should be maintained in the 

scheduler is preferred for simplicity of implementation. primary arbitration queue at any time, as long as there are 

In accordance with the invention, the secondary scheduler 45 pending requests available. In the preferred embodiment, a 
arbitrates among the "y" requests each time a new request is minimum request threshold of two requests indicates that 
needed by the primary scheduler. In the preferred two requests should always be maintained within each 
embodiment, the goal of the secondary scheduler is to select primary arbitration queue. The minimum request threshold 
the oldest request that is requesting an output channel or is a programmable value that can be adjusted on a channel- 
output channels that do not conflict with the output channel so by-channel basis to tune the performance of the queuing 
requests of those requests that are presently being held in the algorithm for each channel. For example, in channels that 
primary arbitration queue. support one or two ports, the I/O controllers typically have 

FIG. 19 is an example of how the arbitration process shorter latency in responding to requests and supplying new 

works for the case where the secondary scheduler 272 requests and as a result, a threshold of two requests is 

arbitrates among eight requests to supply the primary sched- 55 desired. In the channels that support eight ports, the I/O 

uler with one new request. The requests in the secondary controllers typically have longer latency in responding to 

arbitration queue 302 are ordered from oldest to youngest, requests and supplying new requests and as a result, a 

with the oldest request being at the bottom of the queue and threshold of four requests is desired. Minimum request 

the youngest request being at the top of the queue. The threshold values of 0 and 1 have the effect of preventing any 

output channels requested by each request are identified in 60 conflicting requests from being forwarded to the primary 

the queue by the crossbar exit channel descriptor (CEP). The arbitration queue, which may be desirable in some imple- 

primary arbitration queue 282 has three requests accessible mentations. 

to the primary scheduler and needs one new request to fill a The minimum request threshold becomes important to 

free primary arbitration queue location. The requests present filling the primary arbitration queue when the number of 

in the primary arbitration queue are requesting output chan- 65 requests in the primary arbitration queue falls below the 

nels 3, 0 and 1, respectively. The secondary scheduler is in minimum request threshold. When the primary arbitration 

communication with the queue manager 262 of FIGS. 17 queue falls below the minimum request threshold, the queue 
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is filled from the secondary scheduler with the next oldest 
non-conflicting request or the next oldest conflicting request 
if there are no non-conflicting requests available. This 
override of the queuing algorithm is put in place to avoid the 
situation where conflicting requests are not supplied to the 
primary arbitration queue and because of latency in the 
system, an arbitration cycle is performed without a request 
present. 

In light of the enhancement, some additional steps are 
included in the method of FIG. 20. Firstly, between steps 
364 and 366 at logic point 365, it must be determined 
whether or not there are any non-conflicting requests avail- 
able in the secondary scheduler queue. If there are non- 
conflicting requests available in the secondary scheduler 
queue, then at step 366 the highest priority non-conflicting 
request is made accessible to the scheduler. If there are no 
non-conflicting requests available in the secondary sched- 
uler queue, then at decision point 367 it must be determined 
whether or not there are any conflicting requests in the 
secondary scheduler queue and whether or not the primary 
arbitration queue of the scheduler is below its minimum 
request threshold. If both conditions are met, at step 368, the 
highest priority conflicting request is made accessible to the 
scheduler. If on the other hand both conditions are not met, 
at step 369, no new requests are made available to the 
scheduler during the current arbitration cycle. 

FIG. 21 is a depiction of a preferred architecture within an 
I/O controller for supplying the primary scheduler 132 with 
a new request in the case where two ports are connected to 
the I/O controller 246. Similar to FIG. 18, the primary 
arbitration queue 286 stores x requests, where x is preferably 
4. There are two request queues 256 that correspond to the 
two connected ports. Each of the two request queues stores 
some number of requests in addition to the requests that 
make up the primary arbitration queue. In the example, the 
request queues store twelve requests each, although this is 
not critical. 

The secondary scheduler 276 maintains four-deep request 
queues 306 and 316, related to the two ports, of the sequence 
of the four oldest requests, starting with the first request that 
is not included in the "x" requests. The four requests for each 
port are maintained individually on a time basis. The four 
requests are then interlaced in an alternating fashion to 
create a combined request queue 326 that has requests from 
both request queues, preferably four requests from each 
queue 306 and 316 for a total of eight requests. The time 
relationship is maintained between requests from the same 
request queue (i.e., queue "1" or queue "0"), but there is not 
necessarily a time relationship between the requests of the 
two queues. The secondary scheduler then arbitrates 
between the eight requests in the combined queue as 
depicted in FIG. 22 when the primary scheduler needs a new 
request. 

In the example of FIG. 22, the primary arbitration queue 
286 has two requests for output channel 3 (which occurs if 
all previous requests identified channel 3 and the minimum 
request threshold is two) and one request for output channel 
0. The oldest request waiting in the secondary arbitration 
queue 326 also identifies output channel 3. If output chan- 
nels 0 and/or 3 are unavailable to the three requests in the 
primary arbitration queue and the free space in the primary 
arbitration queue is filled from the secondary arbitration 
queue on a strictly FIFO basis, a blocking problem is 
created. All four of the requests in the primary arbitration 
queue are blocked and the entire input channel is unable to 
forward packets until output channels 0 and 3 become 
available. To avoid the blocking problem, in accordance 
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with the arbitration method of the invention, the oldest 
request in the secondary arbitration queue within the sec- 
ondary scheduler is bypassed and the next oldest request is 
reviewed. The next oldest request also conflicts with the 

5 primary arbitration queue at output channel 3. Finally, the 
next oldest request (which identifies output channel 1) is 
supplied to the primary arbitration queue. Under the multi- 
level primary arbitration process described above, the pri- 
mary scheduler can now arbitrate between requests for three 

10 output channels (channels 0, 1, and 3) instead of just output 
channels 0 and 3. 

When a request from the secondary arbitration queue that 
is not the oldest request is supplied to the primary arbitration 
queue as in FIG. 22, the secondary arbitration queue is not 

15 adjusted because, as explained with reference to FIG. 18, the 
secondary scheduler maintains the requests in time order 
even when an out of order request has been supplied to the 
primary arbitration queue. On the other hand, when the 
oldest request from one of the request queues 306 and 316 

20 is supplied to the primary arbitration queue 286, the requests 
in the secondary scheduler 276 of FIGS. 21 and 22 adjust on 
a FIFO basis alternating between ports and add a new 
request to the top of the request queue 306 and 316 from the 
same port as the request that was supplied to the scheduler. 

25 The designation of higher arbitration priority between the 
two request queues 306 and 316 is also switched between the 
two queues each time a request from the queue with the 
higher arbitration priority is selected. That is, the oldest 
request associated with port 1 is the higher priority until a 

30 request from port 1 is supplied to the primary arbitration 
queue and then the arbitration priority is reversed to port 0. 
An advantage of the arbitration method is that the primary 
scheduler 132 is presented with a more broadly distributed 
primary arbitration queue from which to select packets for 

35 transfer through the switch. 

FIG. 23 is a depiction of a preferred architecture within an 
I/O controller 248 of FIG. 17 for supplying the primary 
scheduler 132 with a new request in the case where eight 
ports are connected to the I/O controller. Similar to FIG. 18, 

40 the primary arbitration queue 288 stores "x" requests, where 
"x" is preferably 4 and each of the eight request queues 258 
stores some number of requests in addition to the requests 
that make up the primary arbitration queue. In the example, 
the request queues store at least twelve requests each, 

45 although this is not critical. 

The secondary scheduler 278 maintains one request, pref- 
erably the oldest request, from each of the eight request 
queues. The eight requests are used to create a combined 
secondary arbitration queue 308 that contains eight requests. 

50 The eight requests do not necessarily have a time relation- 
ship between each other and they are ordered based on their 
designated port numbers. Arbitration priority among the 
requests of the combined secondary arbitration queue is 
determined on a rotating round-robin basis. One port con- 

55 taining a request is identified by an arbitration pointer as the 
highest arbitration priority until the request associated with 
that port meets the arbitration requirements and is delivered 
to the primary arbitration queue. The arbitration pointer is 
incremented to the next port containing a request each time 

60 a highest arbitration priority request is supplied to the 
primary arbitration queue 288. 

Referring to FIG. 24, the arbitration process is performed 
similar to the cases above, except that arbitration begins at 
the request identified with the arbitration pointer instead of 

65 the oldest request. In the example of FIG. 24, it is assumed 
that the arbitration pointer is at request 4. Under the arbi- 
tration scheme, request 4 has a conflict with the primary 
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arbitration queue 288 at output channel 1 , as does the next 
priority request, request 5. Requests 6 and 7 have a conflict 
at output channels 2 and 0, respectively. The next request 
reviewed is request 0. Request 0 has a conflict at output 
channel 2 and, therefore, request 1 is next in order for 
review. Request 1 does not have any output channel conflicts 
and, therefore, the request for output channel 3 is supplied 
to the primary arbitration queue. In the preferred 
embodiment, the arbitration pointer is not incremented 
because the request with the arbitration pointer was not 
supplied to the primary arbitration queue. 

FIGS. 18, 19, 21, 22, 23 and 24 and the previous three 
examples are all for situations in which packets and their 
associated requests have time as the only packet priority 
parameter. In other embodiments of the invention, packets 
may have a packet priority parameter in the place of, or in 
addition to, the time parameter. For example, in a preferred 
embodiment, packets can be separated into packet priorities 
based on the application type stored within the packet (i.e., 
audio, video, e-mail, database applications, etc.). As 
described above, four packet priority levels may be desig- 
nated as control, high, medium, and low, where control is the 
highest priority and low is the lowest priority. 

FIG. 25 is a depiction of a preferred architecture within an 
10 controller for supplying the scheduler with a new request 
in the case in which one port is connected to the I/O 
controller and the switch supports four different packet 
priority levels. Similar to FIGS. 18, 21, and 23, the primary 
arbitration queue 300 contains 'V requests, where "x" is 
preferably 4, and four request queues 303 store at least 
twelve requests each, where at least eight of the requests in 
the request queues do not overlap with the requests of "x 
The secondary scheduler 304 maintains a "y" deep request 
queue for each packet priority level where "y" is preferably 
8. In FIG. 25, there are four request queues 309, 310, 312 
and 314 of eight requests for the secondary scheduler to 
consider when a queue space becomes available in the 
primary arbitration queue 300. The arbitration approach of 
the secondary scheduler is based on the packet priority of the 
requests and the age of the request relative to other requests 
of the same packet priority. For example, when a new 
request is needed in the primary arbitration queue 300, the 
"control" priority secondary arbitration queue 309 is 
reviewed first and the oldest non-conflicting request in the 
control priority secondary arbitration queue is selected and 
supplied to the primary arbitration queue. If there are no 
requests stored in the control priority secondary arbitration 
queue, then the next priority queue is reviewed and so on, 
until a queue containing requests is found. If there are no 
non-conflicting requests in the highest priority queue that 
has requests and the minimum request threshold is met, no 
new requests are supplied to the primary arbitration queue 
and the next priority level queue is not reviewed during that 
round of arbitration. For example, if the primary arbitration 
queue was supplied to the minimum request threshold with 
requests for output channel 1 and the control priority queue 
of the secondary scheduler is filled with requests for output 
channel 1, the primary arbitration queue will not be filled 
with a conflicting request from the control priority queue 
and in addition the primary arbitration queue will not be 
supplied with a request from the high priority queue even if 
it contains a non -conflicting request. The reservation of the 
primary arbitration queue is necessary to allow the scheduler 
to maintain the designated priority hierarchy. 

FIG. 26 is a depiction of a preferred architecture of an I/O 
controller for supplying the scheduler with a new request in 
the case in which two ports are connected to the I/O 
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controller and the switch supports four different packet 
priorities. As in FIG. 25, the packet priorities are designated 
as priority levels "control" through "low," where control is 
the highest priority and low is the lowest priority. The 

S primary arbitration queue 330 contains "x" requests, where 
"x" is preferably 4, and each of the eight request queues 334 
preferably stores at least twelve requests. 

As described with reference to FIGS. 21 and 22, com- 
bined secondary arbitration queues 338, 340, 342 and 344 

10 are created for each of the packet priority levels by inter- 
lacing requests from the two ports into eight-deep request 
queues. A separate request queue is generated for each 
packet priority level. The highest priority secondary sched- 
uler queue that contains requests is selected and the queuing 

15 arbitration algorithm is applied to the selected queue to 
identify a request to supply to the primary arbitration queue. 
There is not necessarily a time relationship between requests 
from the two different ports in the combined secondary 
arbitration queues and the arbitration priority between the 

20 requests from the two ports is switched from one port to the 
other in an alternating fashion when a request with the 
highest arbitration priority is supplied to the scheduler. 

Although the case of eight ports and four packet priorities 
is not depicted, the arbitration approach described with 

25 reference to FIG. 23 can be used for each packet priority 
level. As stated above, the invention can be implemented 
with varying combinations of ports and packet priority 
designations while maintaining the fundamental goal of 
supplying the primary arbitration queue with a new request 

30 that targets output channels that are not included in the 
primary arbitration queue. Further, although the secondary 
arbitration is completed in a channel-specific manner, in an 
alternative embodiment, the secondary schedulers have 
knowledge of output channels that are requested on other 

35 I/O controllers, thereby allowing each secondary scheduler 
to provide a broader output channel distribution to the 
primary scheduler. 

As another alternative, in the cases where there are more 
than one packet priority level and the primary arbitration 

40 queue for each channel module is packet priority specific, 
the primary arbitration queue of each channel module can be 
filled from each different priority level queue of the second- 
ary scheduler. That is, the control priority level register in 
the primary arbitration queue will only be filled with 

45 requests from the control priority queue in the secondary 
scheduler and so on for each priority level. 

In one enhancement of the preferred embodiment of the 
invention, if the highest priority request in a secondary 
scheduler is a multicast request, then the multicast request is 

50 supplied to the primary arbitration queue, even if the mul- 
ticast request has conflicting output channels. A conflicting 
multicast request is forwarded over other non-conflicting 
requests when it is the highest priority request in an effort to 
ensure that multicast requests do not get continually passed 

55 over in the secondary arbitration process. In a slight varia- 
tion of the enhancement, a multicast request can be allowed 
to stay in the highest priority request position of the sec- 
ondary scheduler for a designated period of time to see if the 
multicast request will be supplied to the primary arbitration 

60 queue under the standard queuing algorithm. After the 
expiration of the time period, the multicast request is auto- 
matically the next request to be forwarded to the primary 
arbitration queue. 

In another enhancement of the preferred embodiment, 

65 bridged network traffic is queued slightly differently than 
routed network traffic. Bridged network traffic is traffic that 
is forwarded based on layer 2 (i.e., ethemet) protocols and 
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routed network traffic is traffic that is forwarded based on means for queuing second output channel requests that are 

layer 3 (i.e., IP/IPX) protocols. In the enhancement, output inaccessible by said scheduler; 

channel requests for bridged packets that come from the means for determining which output channels are target 

same input port and that are requesting overlapping output output channels of first output channel requests that are 

channels must be queued through the switch fabric in time 5 accessible by said scheduler; 

order even if the older requests contain requests that conflict means for determining a highest priority request main- 

with output channels in the primary arbitration queue. In tained in said queuing means that is indicative of only 

effect, the queuing algorithm is overridden when a series of target output channels that are different than said target 

bridged packets with overlapping output channel requests output channels of said first output channel requests; 

arrives on the same input port in order to keep the proper 10 and 

time sequence among the series of packets. means for delivering said highest priority request to a 

What is claimed is: location that is accessible by said scheduler when said 

1. A method of supplying requests to a scheduler of a scheduler is free to access a new request, 
multiport switch having a plurality of outputs, said scheduler 8. The system of claim 7 wherein each switch fabric 
having access to a plurality of first output requests, said 15 channel is operatively associated with an independent 
method comprising the steps of: arrangement of said means for queuing, said means for 

maintaining a queue of second output requests that are not determining requested output channels said means for 

accessible by said scheduler, each second output determining a highest priority request, and said means for 

request being indicative of at least one target output; 2 o i V ™ ing ' <■ , . „ . c 

. . „ . , n 9. The system of claim 7 wherein said meams for queuing 

determining which outputs are target outputs of said first a ^ r for eacfa - h sajd 

output requests that are accessible by said scheduler; packet switching systenlt 

selecting a highest priority request of said second output io. The system of claim 9 wherein said means for 

requests at least partially based on identifying a par- determining a highest priority request is responsive to more 

ticular second output request for which indicated target 25 thafl Qne of said ^p^g re q Uest queues, 

outputs are mutually exclusive with said target outputs n svstem 0 f c i a j m 7 wherein said means for 

of said first output requests; and determining which output channels are target output chan- 

providing access of said highest priority request to said nels of said first output channel requests is responsive to a 

scheduler. multilevel request buffer that is connected in parallel to said 

2. The method of claim 1 further comprising steps of: 30 scheduler. 

arbitrating between said first output requests that are 12. The system of claim 7 wherein said means for queuing 

accessible by said scheduler; includes separate request buffers for requests that are pri- 

issuing grants to said first output requests when targeted ori " zed b y application type. 

outputs are available; and 35 A ™ {h °t ° f applying requests to a scheduler in a 

, 1 > * j JjCii multiport switch that has a switch fabric with a plurality of 

forwarding packets that are related to granted first output switchi clmmels and out t ^ associated with said 

requests through said multiport switch. switching channels comprising the steps of: 

3. The method of claim 1 wherein said step of selecting a ., 4 . f . t 4 . . ° 4 , , „ t 
highest priority request includes a step of assigning a idenhfymg output channels tarp ted by any first requests 
continuum of time-based priority indicators to each said 40 from a parUcular switching channel that are available to 
second output request such that a second output request said "*wfokr for arbitration; 

having an oldest time-based priority indicator has a highest comparing said identified output channels to output chan- 

priority and a second output request having a youngest nek that are b y second re 4 uests from said 

time-based priority indicator has a lowest priority. particular switching channel that are not available to 

4. The method of claim 1 wherein said step of selecting 45 said scheduler for arbitration; and 

further includes a step of sequencing a priority indicator making available to said scheduler a second request that 

among said second output requests. does Qot tar S et an output channel that is the same as one 

5. The method of claim 1 wherein said step of selecting of said identified output channels targeted by any of 
said highest priority request includes a step of assigning said said first requests, said second request being one of said 
highest priority to a request when said request is the oldest so second requests from said particular switching channel 
request of said second output requests and said request is for mat are not available to said scheduler for arbitration 
multiple outputs even if one of said target outputs is not before being made available to said scheduler, 
mutually exclusive with said target outputs of said first 14 - The method of claim 13 where said step of making 
output requests. available includes identifying and accessing a highest pri- 

6. The method of claim 1 wherein said step of selecting 55 onty request from said requests. 

said highest priority request includes additional steps of 15 The method of claim 14 wherein said step of identi- 

determining if there are more than one request from a same tying and accessing said highest priority request includes a 

input that are requesting overlapping outputs and that are sle P of determining said highest priority request based on 

being bridged, and assigning said highest priority, in comparing time indicators related to said second requests, 

succession, to said requests from said same input even if one 60 16 The method of claim 13 wherein said step of making 

of said target outputs is not mutually exclusive with said available is preceded by: 

target outputs of said first output requests. determining if the number of said first requests meets a 

1, A multiport packet switching system having a multi minimum request threshold; 

channel switch fabric, a data path multiplexer and a if said minimum request threshold is not met and if there 

scheduler, wherein said scheduler grants requests for for- 65 are no second requests that target only output channels 

warding packets through said multiport packet switching that are different from said identified output channels, 

system comprising: making available to said scheduler a highest priority 
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second request even if said highest priority second 
request targets an output channel that is the same as one 
of said identified output channels; and 
overriding said step of making available to said scheduler 
a second request that does not target an output channel 
that is the same as one of said identified output chan- 
nels, 

17. The method of claim 13 wherein said step of making 
available is preceded by a step of receiving an indication that 
said scheduler is free to access a new request. 

18. The method of claim 13 wherein said step of identi- 
fying output channels includes a step of accessing said first 
requests from a multi-level request queue in which said 
queue is connected in parallel to said scheduler. 
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19. The method of claim 18 further including steps of: 
arbitrating between said first requests from said multi- 
level request queue; 

issuing grants on a priority basis to said first requests from 
5 said multi-level request queue when requested output 
channels are available; and 
forwarding packets that are related to granted first 
requests through said multiport switch. 

20. The method of claim 13 further including a step of 
10 maintaining a request queue for each port of said multiport 

switch and wherein said step of comparing includes a step of 
arbitrating between second requests from all queues related 
to ports of said particular switching channel. 

***** 
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